Research

Development of New Methodology to Frame and Address the Impact of Poor Quality Studies on Meta-analysis

Background

When deciding which treatment to offer a patient, you would hope that the doctor will make the decision based on solid evidence.

In health research, one way of gathering evidence is through a “systematic review”. A systematic review collects all available studies on a particular question and then combines the results. Unfortunately, poor quality studies can also be collected along with better quality ones.

Whilst researchers have tools that help identify low quality studies and weak evidence, they do not have the tools to solve the problem.

Aim

· To investigate the “damage” caused by including poor-quality studies.

· To develop practical ways of reducing that damage

The Study

Working with patients and the public, we have explored ways of minimising the problem including:

· Developing an online application to assess potential harms of including poor-quality studies.

· Reducing the impact of very poor-quality studies

· Updating reviews and replacing weak evidence with stronger evidence

We hope this will lead to better reviews, better decisions, and greater public confidence.

Patient and Public Involvement (PPI)

PPI has influenced the study including the:

· Design

· Conduct

· Interpretation

· Sharing findings.

· Co-production of this Plain English summary

Our Public Advisory Group has six members with a diverse range of experience and characteristics, including age, gender, ethnicity, cultural backgrounds, geography and disability.

In order to help the PAG engage with the research, to question and challenge decisions, and provide advice, we have prioritised:

· Building an inclusive environment and trust;

· Providing support and appropriate training,

· Power sharing

Sharing Findings through:

· Presentations, seminars, international conferences and journal articles aimed at researchers, statisticians and academic audiences.

· Making influential organisations aware of our work.

· Presenting our experience of public involvement in research to a professional network of statisticians .

· Our co-produced plain English animated video

· Identifying creative ways of reaching under-served communities